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Abstract 

The demiclosedness principle is one of the key tools in nonlinear analysis and fixed point the- 
ory. In this note, this principle is extended and made more flexible by two mutually orthogonal 
affine subspaces. Versions for finitely many (firmly) nonexpansive operators are presented. As 
an application, a simple proof of the weak convergence of the Douglas-Rachford splitting al- 
gorithm is provided. 
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1 Introduction 



Throughout this paper, we assume that 

(1) X is a real Hilbert space with inner product (-, ■) and induced norm || ■ ||. 

We shall assume basic notation and results from Fixed Point Theory and from Monotone Operator 
Theory; see, e.g., (SHH 13 [lOl [TTl [HI [I5l [HI [HI. The graph of a maximally monotone operator 
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A : X =^ X is denoted by gra A, its resolvent {A + Id) ^ by ]a, its set of zeros by zer A = A ^(0), 
and we set R/i = 2Ja — Id, where Id is the identity operator. Weak convergence is indicated by 

Let T: X ^ X. Recall that T is firmly nonexpansive if 

(2) (Vx G X)(Vy G X) ||Tx - Tyf + || (Id -T)x - (Id -T)yf < ||x - yf . 

It is well know that T is firmly nonexpansive if and only if R = 2T — Id is nonexpansive, i.e., 

(3) (VxGX)(VyGX) ||Rx-Ry|| < ||x-y||. 

Clearly, every firmly nonexpansive operator is nonexpansive. Building on work by Minty ||T3l , 
Eckstein and Bertsekas lH clearly linked firmly nonexpansive mappings to maximally monotone 
operators — the key result is the following: T is firmly nonexpansive if and only if T = for 
some maximally monotone operator A (namely, T^^ — Id). Thus, finding a zero of A is equivalent 
to finding a fixed point of J a- Furthermore, the graph of any maximally monotone operator is 
beautifully described by the associated Minty parametrization: 

(4) graA = {(/aX,x-/ax) I X G X}. 

The most prominent example of firmly nonexpansive mappings are projectors, i.e., resolvents 
of normal cone operators associated with nonempty closed convex subsets of X. Despite being 
(firmly) nonexpansive and hence Lipschitz continuous, even projectors do not interact well with 
the weak topology as was first observed by Zarantonello 11191 : 

Example 1.1 Suppose that X = £2(N), set C = {x G X | ||x|| < l}, and denote the sequence of 
standard unit vectors in X by (e„)„£]N. Set (Vn G N) z„ = eo + en- Then 

(5) z„ eo yet Pcz„ 4=eo ^ cq = Pceo- 



The following classical demiclosedness principle dates back to the 1960s and work by Browder 
Il6ll . It comes somewhat as a surprise in view of the previous example. 

Fact 1.2 (Demiclosedness Principle) Let S be a nonempty closed convex subset ofX,letT:S—>X be 
nonexpansive, let {Zn)n&i be a sequence in S converging weakly to z, and suppose that z„ — Tz„ — > x. 
Then z — Tz = x. 

Remark 1.3 One might inquire whether or not the following even less restrictive demiclosedness 
principle holds: 

z -Vz"^^ xl ^ ^-Tz = x. 

However, this is generalization is false in general: indeed, suppose that X, C, and (x„)„£]n are as 
in Example 1 1.1[ and set T = Id — Pc/ which is (even firmly) nonexpansive. Then x„ Cq and 

Xn - Tx„ = Pcx„ -j^eo yet cq - Tcq = PcCq = eo ^ -j^CQ. 
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The aim of this note is to provide new versions of the demiclosedness principle and illustrate 
their usefulness. The remainder of this paper is organized as follows. Section |2] presents new 
demiclosedness principles for one (firmly) nonexpansive operator. Multi-operator versions are 
provided in Section |3l The weak convergence of the Douglas-Rachford algorithm is rederived 
with a very transparent proof in Section HI 



2 Demiclosedness Principles 



Fact 2.1 (Brezis) (See [F, Proposition 2.5 on page 27], HZl Lemma 4], or ^ Corollary 20.49].) Let 

A: X ^ Xbe maximally monotone, let {x, m) G X x X, and let {x„, u«)nGN be a sequence inX x X such 
that {x„,u„) {x,u) andlim{xn,u„) < {x,u). Then {x„,u„) — )■ {x,u) and {x,u) G graA. 

Theorem 2.2 (See also |2, Proposition 20.50].) Let A: X ^ X be maximally monotone, let {x,ii) G 
X X X, and let C and D be closed affine subspaces ofX such that D — D = (C — C)^. Furthermore, let 
{x„, u„)„(z^ be a sequence in gra A such that 

(7) {x„,Un) {x,u) and {x„,Un) - PcxD{x„,Un) -> (0,0). 

Then (x, m) G (C x D) r\ gra A and {x„,u„) {x,u). 



Proof. Set V = C — C, which is a closed linear subspace. Since Xn — PcXn —> 0, we have PcXn x 
and thus x G C. Likewise, u ^ D and hence 



(8) C = x + V and D = u + V^. 
It follows that 

(9) Pc: z h-^ Pvz + Pv±x and Pd : z ^ Py±z + Pyu. 
Therefore, since Py and Py± are weakly continuous, 

(10a) {Xn,Un) = {PyXn + PyUn + PyLUn) 

(10b) = {PyXn,PyUn) + { 

(lOc) = {PyX„,U„ - Py±U„) + {X„ - PyX„,Py±Un) 

(lOd) = {PyXn,U„ - {PdU„ - PyU)) 

(lOe) + (X„ - (PcX„ - Py±x),Py±M„) 

(lOf) = {PyXn, u„ - PdU„) + {PyXn, Pyu) 

(lOg) + {Xn - PcXn,Py±U„) + {Py±X,Py±Un) 

(lOh) ^ {Pyx, Pyu) + {Py±X, Py±u) 

(lOi) ={x,u). 



The result now follows from Fact 12.11 ■ 
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Remark 2.3 Theorem 12.21 generalizes 111 Theorem 2], which corresponds to the case C is a closed 
linear subspace and D = and which was obtained by a different proof technique. 

Corollary 2.4 (firm nonexpansiveness principle) LetF: X —> X he firmly nonexpansive, let (z„)„g]fsj 
be a sequence in X such that {Zn)n€n converges weakly to z E X, suppose that Fzn x E X, and that C 
and D are closed ajfine subspaces ofX such that D — D = (C — C)^, Fz„ — PcFzn 0, {z„ — Fz^) — 
PoiZf, — Fz„) — > 0. Then a: G C, z G x + D, and x = Fz. 



Proof. Set A = F ^ — Id so that J a = F. By (H)), A is maximally monotone and 
(11) {xn,u„)„^fsi := {Fz„,z„ — Fz„)„eisj 

is a sequence in gra A that converges weakly to {x, z — x). Thus, by Theorem l2.2l x E C,z — x E D, 
and z — X G Ax. Therefore, z G x + Ax, i.e., x = Jaz = Fz. ■ 

Corollary 2.5 (nonexpansiveness principle) Let T: X — > X be nonexpansive, let {z„)„(z^ be a se- 
quence in X such that z„ z, suppose that Tz„ y, and that C and D are closed affine subspaces ofX 
such that D — D = (C — C)^, z„ + Tz„ — PcZn — PcTzn —> 0, and z„ — Tzn — Pv^n — Pd{ — Tz„) —> 0. 
Then ^z + G C, \z — jyE D, and y = Tz. 



Proof. Set F = ^ Id +2r, which is firmly nonexpansive. Then Fz„ jZ -\- \y =: x. Since Pq is 
affine, we get 

(12a) Zn + Tzn - Pcz„ - PcTZn ^ 

(12b) ^Z„ + TZn - 2{\PcZn + \PcTZn) ^ 

(12c) Oz„ + Tz„-2Pc(^z„ + irz„) ^0 

(12d) ^ 2Fz„ - 2PcFz„ -> 

(12e) O Fz„ - PcFzn -> 0. 

Likewise, since z„ — Fz„ = z„ — ^z„ — \Tz„ = \zn — \Tzn, we have 

(13a) z„ - Tz„ - PoZn - Poi-Tzn) ^ 

(13b) ^z„- Tz„ - 2(iPDZ„ + iPD(-Tz„)) ^ 

(13c) O 2(z„ - Fz,) - 2PD(iz„ + |(-Tz,0) ^ 

(13d) z„ - Fz„ - Pd(z„ - Fz„) ^ 0. 

Thus, by Corollary I2.4[ x G C, z G x + D, and x = Fz, i.e., ^z + e C, z e \z+\y + D, and 
^z + ^1/ = Fz = ^z + ^Fz, i.e., \z + \y ^ C, \z — \y& D, and y = Tz. ■ 

Corollary 2.6 (classical demiclosedness principle) Let Shea nonempty closed convex subset ofX, let 
T: S —> X be nonexpansive, let (z„)„g]N be a sequence in S converging weakly to z, and suppose that 
z„ — Tz„ — > X. Then z — Tz = x. 
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Proof. We may and do assume that S = X (otherwise, consider T o Pg instead of T). Set y = z — x 
and note that Tz,, ^ y. Now set C = X and D = {x/2}. Then D - D = {0} = = (X - X)^ = 
(D - D)^, Zn + Tz„ - Pcz„ - PcTz„ = and z„ - Tz„ - PoZn - Pd{-Tz„) = z„ - Tzn - x/2 - 
x/2 — > 0. Corollary 12.51 implies y = Tz, i.e., z — x = Tz. ■ 



3 Multi-Operator Demiclosedness Principles 

Set 

(14) I = {1,2, . . . ,m}, where m is an integer greater than or equal to 2. 
We shall work in the product Hilbert space 

(15) X = X^ 

with induced inner product (x,y) = ^ifzj{xi,yi) and ||x|| = y^Yyiei W^iW^' where x = (x,),^/ and 
y = {yi)i<^i denote generic elements in X. 

Theorem 3.1 (Multi-Operator Demiclosedness Principle for Firmly Nonexpansive Operators) 

Let (f/Oie/ be a family of firmly nonexpansive operators on X, and let, for each i G I, (z,^„)„eN be a 
sequence in X such that for all i and j in I, 

(16) Z;;„ ^ Z; and f,z,;„ ^ x 

(17) ~ ^'^''") ^ + ^ ^' 

(18) FiZi^r, - FjZj,„ ^ 0. 
Then F,z, = x,for every i G /. 

Proof. Set X = {x)i^i, z = (z;);ej, (z„) = (z,-,„)„e]N, and C = { (y)/^/ | y G X}. Then z„ ^ z and C 
is a closed subspace of X with = { (y;);ei | '^Ziei Vi = O}- Furthermore, we set D = z — x + 
so that (C — C)^ = = D — D, and also F: (y,),^/ ^ {PydiGi- Then F is firmly nonexpansive 
on X, and Fz„ ^ x. Now ((18)) implies 

(19) (VzGJ) F,-z,„-l Vfyz^'„ ^0, 

m ^ ' ' 

which — when viewed in X — means that Fz„ — Pc^z„ — ?► 0. Similarly, using ((T7)l , 

(20a) Zn - Fz„ - Pd(z„ - Fz„) = z„ - Fz„ - P^^^^c^{z„ - Fz„) 

(20b) = z„ - Fz„ - (z - X + Pq± (z„ - Fz„ - (z - x))) 

(20c) = ( Id -Pc±) {Zn - FZn) - ( Id -Pc±) (Z - x) 
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(20d) =Pc(zn-Fz„)-Pc(z-x) 

(20e) = (m 2Z (^''" ~ + ^ 

iei 

(20f) ^ 0. 



Therefore, by Corollary 12.41 x = Fz. ■ 

Theorem 3.2 (Multi-Operator Demiclosedness Principle for Nonexpansive Operators) 

Let {Ti)i(zi be a family of nonexpansive operators on X, and let, for each i S I, (x;;„)„giN be a sequence in 
X such that for all i and j in I, 

(21) z,;„ ^ Zj and T,z,;„ ^ y,- 

(22) Yl i^i'" ~ ^'^'>) ^ Yl ~ V') 

(23) Zi^fi Zj^n + T,Z; TjZj^fi ^ 0. 
Then TiZj = yi,for each i s 1. 

Proof. Set (Vz G 7) F, = \ Id Then f, is firmly nonexpansive and F,z, „ ^ jZ, + ^i/i, for every 

/ e L By <l23ll, ^ 2f,z;,„ - 2Fyz^;„ = (z;,„ + r;z,;„) - [zj^n + T,zy,„) ^ {zi + yi)- {zj + yj), for all i 
and y in J. It follows that x = ^z, + ^y, is independent of z G F Furthermore, 



(24a) ^ (z,;„ - F,z,;„) = ^ 2 (2'> ~ '^'^^i,") 

iei iei 

(24b) 

(24c) =^(iz,-(x-lz,)) 
(24d) = -mx + y^Z;. 

Therefore, the conclusion follows from Theorem l3.1[ 

4 Application to Douglas-Rachford splitting 

In this section, we assume that A and B are maximally monotone operators on X such that 

(25) zer(A + B) = (A + B)-^(0) 7^ 0. 
We set 

(26) T = lld + iRgR^ = /b(2/^ - Id) + (Id -7a), 
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which is the Douglas-Rachford splitting operator. See 121 for further information on this algorithm, 
and also [S] for some results for operators that are not maximally monotone. It is not hard to check 
(this is implicit in |(T2l and [9]; see also 10 Proposition 25.1(ii)]) that 



(27) /^(FixT) =zer(A + B). 
Now let zq G X and define the sequence (zn)nG]N by 

(28) (Vn e N) Zn+i = Tzn. 

This sequence is very useful in determining a zero of A + B as the next result illustrates. 

Fact 4.1 (Lions-Mercier) [12J The sequence {zn)nGK converges weakly to some point z G X such that 
z G Fix r and J^z G zer(A + B). Moreover, the sequence {jAZn)nGn is bounded, and every weak cluster 
point of this sequence belongs to zer(A + B). 

Since ]a is in general not sequentially weakly continuous (see Example II. ID , it is not obvious 
whether or not /aZ„ ^ J^z. However, recently Svaiter provided a relatively complicated proof 
that in fact weak convergence does hold. As an application, we rederive the most useful instance 
of his result with a considerably simpler and more conceptual proof. 

Fact 4.2 (Svaiter) [17J The sequence {jAZn)nGiN converges weakly to Jaz. 



Proof. By FactHH 

(29) z„ ^ z G Fix r. 

Since }a is (firmly) nonexpansive and (z„)„g]N is bounded, the sequence {jAZn)nGK is bounded as 
well. Let X be an arbitrary weak cluster point of (/AZnjneN/ say 

(30) }AZk„ zer{A + B) 
by FactHH Set (Vn G N) y„ = RaZu- Then 

(31) yfc„ - y = 2x - z G X. 

It is well known that the sequence of iterates of any firmly nonexpansive operator with fixed 
points is asymptotically regular [7|; thus, 

(32) ]aZ„ - Jsyn = Zn - TZ„ -> 

and hence 

(33) Jsi/fc,, ^ X. 
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Next, 



(34a) ^ }AZk„ - hVkn 

{34b) = - ]AZk„ + RaZ|c„ - iBVkn 

(34c) = Zk„ - JaZu,, + Vk,, - IbVk 

(34d) ^ z + y-2x. 

To summarize, 

(35a) {zk„,yk„) (z,y) and {jAZk„, jByk„) ^ {x,x), 

(35b) (Zfc^ - }AZk„ ) + (y)c„ - jBVkn ) ^ -2x + z + y = 0, 

(35c) /aZ;c„ - jBVk,, 0. 



By Theorem 13. 1[ JaZ = JbV = x. Hence /aZjc„ ^ JaZ- Since x was an arbitrary weak cluster point 
of the bounded sequence (/aZ„)„£]n, we conclude that /aZ„ ^ JaZ. ■ 

Remark 4.3 Generalizations of Fact 14.21 appear in l|T7| , ||2ll, and a forthcoming preprint by 
Dr. Patrick L. Combettes. 
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